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ABSTRACT 



A secondary packetized data stream, such as a commercial, 
is spliced with a primary packetized data stream, such as a 
network television program. The system does not require 
decompression of the data in the primary data stream, and is 
particularly suitable for use al a cable system headend to 
allow the insertion of commercials from local businesses 
into a nationally broadcast television program. When a start 
signal is received, a pre-splicing packet of the primary 
stream is determined. The pre-splicing packet is the packet 
closest to the start time which carries an anchor frame (e.g., 
I or P frame) start code. To prevent a potential discontinuity 
at the decoder, the pre-splicing packet is processed to discard 
the anchor frame data, and to insert a number of slufiBng 
bytes which is equal to the number of bytes discarded into 
an adaptation field of the pre-splicing packet. To further 
maintain continuity at the decoder, identifying data of the 
primary stream such as PID and PSI data, is retrieved and 
provided to the secondary stream. A number of null packets 
are inserted into the output stream at the transition point 
between the main program and the commercial to prevent a 
buffer overflow at a decoder which receives the output 
stream. 

29 Claims, 14 Drawing Sheets 
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SPLICING COMPRESSED PACKETIZED 
DIGITAL VIDEO STREAMS 

BACKGROUND OF THE INVENTION 

The present invention relates to the communication of 
digital video signals, and more particularly, to the insertion 
of digital video messages such as commercials into a pre- 
existing compressed packetized data stream. Data packets of 
the commercial message are sphced into a pre-existing data 
stream (complying, e.g., with the Moving Picture Experts 
Group (MPEG) transmission standard) without decompress- 
ing the data in the data stream, and while maintaining 
compliance with the MPEG or similar digital data commu- 
nication protocol. 

Digital transmission schemes are particularly advanta- 
geous for signals that are broadcast from a main of&ce by 
sateHite to a cable television afiBliate at a system headend. At 
the system headend, the digital data stream may be further 
processed and distributed to the cable system customers, for 
example, via a Hybrid Fiber Coax (HFC) or Fiber to the 
Curb (FTTC) network. Such an arrangement is known as an 
end-to-end digital network since digital video is compressed 
and transmitted from a programming source at a central 
office all the way to each customer's home. In an HFC 
network, a distribution line includes both a coaxial cable 
which carries radio-frequency signals, and an optical fiber 
which carries light wave signals. In a FTTC network, an 
optical fiber carries the data stream from the cable system 
headend to a neighborhood transfer point, or drop, and 
conventional coaxial cable carries the signal from the drop 
to the customer's home. At the customer's home, a decoder 
processes the digital signal to provide a signal for display on 
a television or other display device. 

In such cable distribution systems, the received data 
stream may be processed at the headend prior to distribution 
to the system customers. In particular, commercial messages 
from local businesses may be inserted into the main pro- 
grams. However, in order to accomplish this, conventionally 
the received digital data stream must be completely 
demodulated, demultiplexed, decrypted, decompressed and 
decoded to recover the signal in the analog domain. Then, 
the desired commercial message is provided in the analog 
domain and inserted into the signal to provide a new analog 
combined signal. Finally, the analog combined signal is 
digitized, encoded, compressed, encrypted, multiplexed and 
modulated for transmission to a customer's home. As can be 
seen, this process leaves much to be desired as it requires a 
number of time-consuming steps that must be implemented 
with additional hardware, including magnetic tape recorders 
and players. Moreover, a large magnetic tape library must be 
maintained and indexed. Furthermore, the conversion from 
digital to analog and back to the digital domain may result 
in degradation of the signal quality. 

Thus, it would be desirable to provide a system for 
allowing an auxiliary compressed digital signal such as a 
commercial message to be inserted into a compressed digital 
signal of a main program without requiring decompression 
of the data in the main program signal. Such a system should 
allow cable system headed operators to conveniently insert 
commercial messages into a main program which is 
received, for example, via a nationwide or international 
satellite distribution network. Additionally, the system 
should not degrade the quality of the main program. In 
particular, the system should avoid any discontinuity which 
results in a non-compliant data stream. The system should 
also preclude problems such as syntax violations, decoding 
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errors, buffer overflow or underflow, timing recovery prob- 
lems due to discontinuous system time stamps, audio/video 
synchronization problems, and video display artifacts. 
Furthermore, the system should be compatible with MPEG 
5 and similar digital data communication standards, in addi- 
tion to being fully compatible with existing decoder tech- 
nology. The present invention provides a system having the 
above and other advantages. 

10 SUMMARY OF THE INVENTION 

In accordance with the present invention, a method and 
apparatus are presented for splicing a secondary packetized 
data stream, such as a commercial, with a primary pack- 
etized data stream, such as a network television program. 
Advantageously, the system does not require the decom- 
pression of the data in the primary data stream, and is 
particularly suitable for use at a cable system headend. 

A start signal is provided to indicate the time to initiate the 
splicmg, that is, when to insert the commercial. The start 
signal may be embedded as data in the main program, in 
which case it must be recovered. Alternatively, the cable 
system operator may provide an external time signal. In 
either case, once the start signal has been received, a 
pre -splicing packet of the primary stream is determined. 
Normally, the pre-splicing packet is the packet closest to the 
start time which carries an anchor frame start code. The 
anchor frame start code indicates that data of an I or P frame 
is carried in the packet. Typically, such a packet may carry 
data from the I (or P) frame, and the frame which immedi- 
ately precedes the I (or P) frame. To prevent a potential 
discontinuity at the decoder, the pre-splicing packet is 
processed to discard the anchor frame data, and to insert a 
number of stuffing bytes which is equal to the number of 
bytes discarded into an adaptation field of the pre-splicing 
packet. An adaptation field is created if it does not already 
exist. 

Additionally, to maintain continuity at the decoder, iden- 
tifying data of the primary stream such as PID and PSI data, 
is retrieved and provided to the secondary stream. 

Furthermore, it may be necessary to insert a number of 
null packets into the output stream at the transition point 
between the main program and the commercial. In 
particular, a number L of null packets are provided in the 
45 output stream to prevent a buffer overflow at a decoder 
which receives the output stream. The null packets are 
inserted between the pre-splicing packet of the main pro- 
gram and the first packet of the commercial. Similarly, when 
there is a transition back from the commercial to the main 
50 program, additional null packets may be inserted. The num- 
ber L is determined according to the data rates of the primary 
and secondary streams, and provides a corresponding pad- 
ding delay time which reduces the decoder's buffer level. 
Also, at the transition back from the commercial to the 
55 main program, a post -splicing packet of the main program 
which follows the pre-splicing packet is determined. 
Typically, the post-splicing packet will have a sequence start 
code which follows the sequence end code which is asso- 
ciated with the last packet of the commercial. The post- 
60 splicing packet is positioned to follow the last packet of the 
commercial in the output stream. Moreover, processing of 
the post-splicing packet is analogous to processing of the 
pre-splicing packet. Specifically, data in the post-splicing 
packet which is associated with an immediately preceding 
65 packet, which may or may not be the same as the pre- 
splicing packet, is discarded to prevent a discontinuity at the 
decoder. Moreover, an amount of stuffing data is added to an 
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adaptation field of the post -splicing packet based on the FIGS. 14a and 146 show a post-splicing data packet 

amount that was discarded. An adaptation field is created if having no adaptation field or PES header before and after 

it does not already exist. processing in accordance with the present invention. 

A corresponding apparatus, including an insertion pro- nPSPRlPTTON OF THF 

cessing module, is also presented. S DETAILED DES^C^TON OF THE 

A decoder is also presented for decoding a transport data 

stream which comprises a main program and a commercial. A method and apparatus are presented for splicing a 

The decoder includes a buffer for storing the transport data. secondary packetized data stream, such as a commercial, 

The buffer has a size that is modeled at the insertion with a primary packetized data stream, such as a network 

processing unit by a virtual buffer scheme. A processor is television program. 

coupled to receive data from the buffer for processing to piQ. l is a block diagram of a Fibcr-to-the-Curb Digital 

provide a signal which is routed to a television for display video Distribution Network in accordance with the present 

of the main program and the commercial, in turn. A number invention. The distribution network includes Mdeo Infor- 

L of nuU packets are provided between a pre-spHcing packet mation Providers (VIPs) shown generally at 100, a gateway, 

of the main program and a first packet of the commercial to sjio^vn generally at 120, an access network, shown generally 

prevent overflow of the buffer. In particular, the number Lis at 140, and the home of a Video Information User (VIU), 

determined according to the respective data rates of the main shown generally at 160. The gateway 120 may comprise an 

program and the commercial. Additionally, L may be deter- y Gateway manufactured by Teleco. The VIPs may include 

mined according to a decoding delay time of the decoder, ^ video server 102, an interactive data server 104, and an 

and according to a padding delay which prevents a decoding internet gateway 106, all of which communicate with an 

discontinuity. The decoder provides a signal for display on asynchronous transfer mode (ATM) network 122 via, for 

a display device such that a transition between the main example, an OC-3 system, where opUcal fiber is used to 

program and the commercial, and back again, is subslan- transmit data at 155.52 Mbit/sec. The ATM network 122 

tially seamless. may also receive data via a satellite receiving antenna 110, 

BRIEF DESCRiraON OF THE DRAWINGS broadcast encoder and seiver 112, and ATM multiplexer 114. 

The ATM network 122 communicates with a session man- 

FIG. 1 is a block diagram of a Fiber- to-the- Curb Digital ager 123. 

Video Distribution Network in accordance with the present The ATM network 122 may provide information to one or 

invention. more access networks, such as a cable television distribution 

FIG. 2 is a block diagram of a Hybrid Fiber Coax Digital headend 140. First, however, the information from the ATM 

Video Distribution Network in accordance with the present network is processed via a Digital Ad Insertion Module 

invention. (DAIM) 130 in accordance with the present invention. 

FIG, 3 is a block diagram of a Digital Ad Insertion Information, such as a network television program, passes 

Module in accordance with the present invention. 35 between the ATM network 122 and the DAIM 130 via an 

HG. 4 is a block diagram of an Insertion Processing Unit ATM receiver (Rx) interface (I/F) 124. The DAIM 130 

of a Digital Ad Insertion Module in accordance with the receives the information as a compressed digital packetized 

present invention. ^^^^ stream and accesses an inserted stream storage unit 135. 

HG. 5 illustrates the processing flow of the Insertion Th<= storage unit may include a digitized library of adver- 

Processing Unit of FIG. 4 in accordance with the present 40 lisements (e.g., commercials) which are available to insert 

invention network television program. The storage unit 135 

' , ^ J. 11 ^ u - may include digital audio tapes (DATs), digital video disks 

FIGS. 6a to 6c are diagrammatic illustrations showing /^^T7T^ \ * j- /r^r-, \ Z „ *■ 

. ■ 1.1 1 nr-o t * • A ' * 4i A (DVDs), compact audio discs (CDs) or other magnetic or 

how vanable length PES packets are reorganized into fixed o t eal stora e media 

length transport packets for use in providing a transport " ^ ^ . , " . , , ,^ 

multiplex for transmission. 45 In accordance with the present mvention, the DAIM 130 

T-TA^o ^«JL 1-' J. i.u- inserts a compressed digital packetized advertisement 

FIGS. 7a-ld show a pre-splicing data packet having an ^ • . r,- ,1 1 j j * . r 

J . £ u J r>T-o L J L r J • stream into the compressed digital packetized data stream 01 

adaptation field and PES header before and after processmg .i.i - - *u 

^ , ^i. .1. . • the network television program without decompressing the 

in accordance with the present invention. - , T *i. * i • • , r 

. program. Moreover, when the television program is in an 

HGS. Sa and 8b show a pre-spliang data packet having mPEG-2 or similar format, the DAIM maintains compliance 

an adaptation field but no PES header before and after ^-^j^ ^j^^ MPEG-2 protocol. Of course, while the embodi- 

processing in accordance with the present invention. ^^^^ p,Q ^ ^ particularly suited for the insertion of 

FIGS. 9a-9d show a pre-splicing data packet having no advertisements into a network television program, there are 

adaptation field but with a PES header before and after many other useful applications, including the insertion of 

processing in accordance with the present invention. educational programming, emergency messages such as 

FIGS. 10a and 10Z> show a pre-splicing data packet having weather bulletins, informational messages from the cable 

no adaptation field or PES header before and after process- system operator, and the like. Furthermore, audio only or 

ing in accordance with the present invention. data only messages may be inserted into the main packetized 

FIGS, lla-lld show a post-splicing data packet having data stream. Moreover, the same message may be inserted 

an adaptation field and PES header before and after pro- into more than one main program at the same time, and 

cessing in accordance with the present invention. different messages may be inserted into different main 

FIGS. 12fl and 12b show a post-splicing data packet programs at the same time, 

having an adaptation field but no PES header before and A compressed digital packetized data stream which 

after processing in accordance with the present invention, includes the inserted message combined with the main 

FIGS. 13a-13d show a post-splicing data packet having 65 program is output from the DAIM 130 to an ATM trans- 
no adaptation field but with a PES header before and after raitter (Tx) interface 126, and then provided to an access 
processing in accordance with the present invention. network (e.g., cable system headend) 140. In the access 
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network 140, a Host Digital Terminal (HDT) 144 receives is provided to a Main Stream Parser (MSP) 415. The MSP 

the data stream and also receives control signals from an also receives an input labeled T__in, which is the desired 

element manager 142, which manages the cable network. starting time of the insertion of the insertion stream into the 

The HDT 144, which is a speciaHzed digital switch which is main stream. Similarly, after processing by the packet 

typically located in a head office of the cable system, s framer 410, the insertion stream is provided to an Insertion 

communicates with one or more Optica] Node Units stream Parser (ISP) 420. The ISP also receives an input 

(ONUs), including ONU 146. The ONU is located in the labeled T_out, which is the desired ending time of the 

local curb, and supports an optical to electrical conversion insertion of the insertion stream into the main stream. T_Jn 

and modulation/demodulation. The ONU 146 then provides ^^^^^^ ^^^^^^^ ^ provided 

the data stream over a coax distnbution network to one or j^^^^y^ ^^^^ ^ ^^^^^ ^^^^^^ headend. Similarly, 

more subscnber's homes or ofBces. At each home, a drop ^^^-^^ ^^^^^^^ insertion stream, 

box 164 located near the home receives the combined digital generated locally. 

signal and provides it to a Digital Entertainment Terminal . ^ A^e ^ A^i^ u-.*o«f 

/i^j^ r J J \ J KT 1 T * f x€ A 1 The mam stream parser 415 parses the data packets ot the 

ffi 'i '^^'^nnl f a Network Interface Module ^^.^ ^^^^^^ ^^^.^^^ ^ ^.^^^ ^^^^^ ^ 

(MM) 166. The DET decodes the packetized data s^^^^^^ ^^5. These signals include a Program Qock Reference 

and the signal is seamlessly ^^^^ to the ^ ^ ^.^^^ ^.^ 

Video Infonnauon User (VIU) (e.g., subscnber) via televi- ^^^^ ^^^^^^ Similarly the insertion stream 

sions 170, 172 and/or personal computer 174. "^^ ^^0 parses the data packets of the insertion stream to 

FIG. 2 IS a block diagram of a Hybnd Fiber Coax Digital -^^ p^R.^ j^^g, ^^^^^^ to the video buffer 

Video Distribution Network in accordance with the present ^^5, where the prime notation indicates a param- 

invention. Like-numbered elements correspond to the ele- ^^^^ .^^^^^^^ stream. The video buffer manager 425 

mentsofFIG.l.TliedistribuUonnetworkincludesasatellite ^^^^^ ^.^^^^^ ^ determine a number, N, of null 

uplink, shown generally at 200, a satellite downlmk, shown ^^^^ ^^^^^ .^^to the output data stream, 

generally at 240, an access network 140 and a VIU's home particular, to avoid a decoder buffer overflow, it may be 

160. The satellite uphnk 200 includes a broadcast encoder ^5 necessary to add null packets to the output stream during the 

and server 205, which may also perform an encryption transition from the main to the insertion stream, and during 

function, an MPEG multiplexer 210, a modulator 215, and transition from the insertion to the main stream, if the 

a transmitting antenna 220. The satellite downlink 240 insertion stream has a higher data rate than the main stream, 

includes a receiving antenna 242, and an mtegrated receiver ^^^^^^ ^^^^^^ provided to a null packet 

244. The signal received at the antenna 242 typically com- 30 generator 430 and then to a Data Buffer (DB) 485 which is 

prises a multiplex of encrypted channels (e.g., one hundred ^^^^ ^^^^^^ ^^q^^ 475 4^5 communicates with 

or more channels) from various programming service pro- ^ syntax processor 470 

yiders The received multiplexed signal is processed at the ^^^.^^^ ^^^^^ ^^^^ 

integrated receiver 244 by a demodulator 246 and decryp- ^ ^^^^^ "^^j^^ communicates with a 

tion tunction 35 syntax processor 470. The main stream buffer 480 is part of 

Hie recovered mulUplex of channels is then provided to ^ ^^q^^ j^g^^i^j, 3,,^^^ ^^^^^ 430 

the DAIM 250 for processing in accordance with the present .^^^ .^^.^^ ^^^^^^ ^,^,3 ^ p^^g,,^ specific 

invention. The DAIM accesses an mserted stream storage ^^f^.^^^i^^ (PSI)/Program Identifier (PID) Replacer 435, 

unit 135 to retrieve a compressed digital packetized message ^^j^j^ pgj j^^les and PIDs of the insertion 

for insertion into one or more main channels of the mulu- 40 ^j^^m with those of the main stream. TTie PSI/PID replacer 

plex. Aftfir processmg by the DAIM, the one or more ^5 ^^^^^^^ ^^^^ ^^j^^^^^ information from the main stream 

combined signals are received by a transcoder 260 for ^ communication path which is not shown. The PSI 

encryption and/or modulation at function 265 as well pjp j^j^ ^^^^ ^^^^ ^^^y^ ^^^^ informaUon to 

known in the art. The multiplex of signals, mcluding the ^^^^^^ ^^^.^^ ^^^.^^ ^^^^^^ j^j^ p^j.^g(5 ^ 

signal with the inserted messages, is then received by the 45 p^ttioiUt programming service. Specifically, this is aceom- 

access network 140 and transmitted to the subscnbers ^jj^^^^ ^^j^, ^ p^^gr^ Association Table (PAT) and a 

homes for display at the VIU's home 160 as discussed in ^^^^^ j^^^ .j.^^^ ^pj^^ ^j^^^^ t^^^ 

connection with FIG. 1. provided to an Insertion Stream Buffer (ISB) 490, which is 
FIG. 3 is a block diagram of a Digital Ad InserUon p^^, ^^fp^f ^^g^^ 475 j^g 499 communicates 
Module (DAIM) in accordance with the present invention. 50 ^ syntax processor 470. Furthermore, the output buffer 
Advantageously, the DAIM 300 is compatible with existing 475 receives commands from a buffer controUer 465 to 
communication networks, including the Fiber-to-the-curb provide an output stream with the insertion stream seam- 
network of FIG. 1, and the Hybrid Fiber Coax network of j^^^y ^pjj^j ^^jj, stream. 
FIG. 2. nie DAIM receives a main stream (MS) which p^^^^^ ^^^^.^ ^^^^^ „f ^j^^ .^^^^j^^ 
comprises a pnmary data stream such as a network televi- S5 ^cessing unit 400 of FIG. 4 will now be discussed. The 
sion program, and an insertion stream (IS), which composes foiij,^j„^t,rms and variables will be used: 
a secondary data stream such as a commercial message. rr^^T , • tt • -j i^- •* i 
Within the DMM, an external control interface 310 com- 1^^: InserUon Processing Umt-a unit inside the Digital 
municates with an Insertion Processing Unit (}?V) 400. Ad-Insertion Module^ . . , 
After the commercial message is inserted into the main 60 ^^^^ Stream (MS): The mcommg digital stream that 
stream, an output stream is produced. carries the normal digital video programmmg services. 

FIG. 4 is a block diagram of an Insertion Processing Unit Insertion Stream (IS): The digital stream segment that will 

(IPU) of a Digital Ad Insertion Module in accordance with be inserted mto the main stream, 

the present invenrion. The IPU, shown generally at 400, Output Stream (OS): The outgoing main stream after 

receives the main stream at a packet framer 405, while the 65 insertion. 

insertion stream is received at another packet framer 410. T_Jn: The external signal indicating the desired starting 

After processing by the packet framer 405, the main stream time of the insertion in the main stream. 
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T_out: The external signal indicating the desired ending insertion stream into the main stream. Note that the terms 

time of the insertion in the main stream. "insertion stream," "secondary stream," or the like as used 

sp„in: The insertion starting position, or splicing start herein can denote replacement (e.g., overwriting) of packets 

point, in the main stream. It is generated internally by of the main stream as well as insertion without loss of any 

the DAIM, and is not necessarily coincident with T_in. S main stream packets. However, this latter case will require 

sp_out: The insertion ending position, or splicing end ^ ^^^^^ "^^"^^7, f 

point, in the main stream. It is generated internally by l^^icb is temporarily suspended while the inserUon 

the DAIM, and is not necessarily coincident with stream is transmitted. , ^ , 

J If the mam stream carries a plurality of programs, the IP U 

7". ^ . . ^ , . . .10 can insert the packets of the insertion stream into transport 

sp m': The starting posiUon of the insertion segment in ^^^^^^^ ^^-^ ^^^^^^ ^^^^ ^^1^^ ^ ^^^^ 

the insertion stream. selected programs. In this case, the data rate of each elemen- 

sp_out': The ending position of the insertion segment in tary stream in the insertion stream should be the same as the 

the insertion stream. data rate of the corresponding programs in the main stream. 

MPEG: Moving Picture Experts Group for video, audio 15 For example, the rate of a video elementary stream in the 

and system coding format. insertion stream should be equal to the rate of the video 

TS: The MPEG Transport Stream which uses the 188 byte elementary main stream which is to receive the insertion 

packet format. ^^ta. The IPU processes the packets near the beginning and 

Null Packet: A transport packet that does not contain any ''"'^ ^'^^"^ » '^^''"8 ^""^^ '^EG 

valid audio/video data. 20 compliant. 

f 11 V stream packet framer 405 receives a ruUy 

L: Number of null packets. compliant, unaligned MPEG-2 main transport stream at its 

PID: The Program IDentifier carried in each MPEG channel input. The main stream data is in a serial format. The 

transport packet indicating the presence of a data MPEG-2 transport packet synchronization byte may occur at 

stream, 25 any bit position. The packet framer 405 provides the trans- 

PSI: Program Specific Information carried in the transport port packet alignment, and outputs a transport stream which 

packet indicating the mapping of a group of PIDs to is aligned to the packet boundary. The insertion stream 

individual programs. It includes PAT/PMT. packet framer 410 performs a similar function for the 

PES: Packetized Elementary Stream is a layer of data insertion stream. 

carried by the TS. Main Stream Parser (MSP) 415 and Insertion Stream 

T-c * o. « u *-i A' A * Parser (ISP) 420 are used to parse the main stream and 

ES: Elementary Stream— can be video, audio, or data, . . ^ ^ , , 4I . 

^ . msertion streams, respectively. The stream parsers parse the 

PGR: Program Clock Reference— system clock lime respective aligned streams of the packet framers 405 and 

stamps which arc carried m the mam stream. ^^^^ transport layer to the picture layer. At a time 

PGR': Program Qock Reference — system clock time 35 prfor to T_in, the MSP 415 bypasses the main stream in its 

stamps which are carried in the insertion stream. inp^t and send the stream directly to the main stream buffer 

DTS: Decoding Time Stamps indicating the decoding 480, and the ISP 420 parses the input insertion stream to 

time of each ES element in the main stream. locate the sequence start code. When a packet with a 

DTS': Decoding Time Stamps indicating the decoding sequence start code is detected in the insertion stream, the 

time of each ES element in the insertion stream. ^0 ISP puts the address of this packet into a register (not 

R v: Video bit rate for the main stream. ^^^'^^^ ^ ^ ^^^^ ^^^^^^ 

stream. 

R_V: Video bit rate for the insertion stream. ^ ^^^^ ^ ^^^^^ ^ detected, the MSP parses the main 

Sequence Header: The highest layer of header in a MPEG stream to locate the transport packet with the next, or most 

video stream. 45 recent previous (if still available), anchor picture start code. 

GOP Header: Group of Pictures header — the second layer When an I or P picture start code is found in the main stream 

of header followed by a complete self-contained transport packets, the MSP 415 sends the transport packet 

sequence of pictures (e.g., frames). which contains the anchor picture start code (e.g., the last 

Picture Header: The header which precedes each picture. packet of the main stream) to the syntax processor 470 for 

I Picture: Intra-coded picture that can be decoded without 50 processing. Also at this time, the ISP 420 sends the first 

referring to another picture packet of the insertion stream to the syntax processor 470 to 

P Picture: Foiwaid predicted picture that can be decoded ^e "fixed-' or "^paired", as discussed below in greater 

using the previo.^ decoded I or P picture. f =f^- ^^".^ buffer venfier (e.g. MPEG parameter 

. t • vbv_buffer J management IS required, the MSP 415 and 

Anchor Picture: I or P pictures are anchor pictures since j^p ^ also have to paise the PGR, DTS, video rate 

they may be used as a reference to predict another ^^^^^ parameters as required, store them 

picture. in the data buffer 485, and provide them to the video buffer 

B Picture: Bi-directionally predicted picture that can be manager 425. 

decoded using the previous and next I or P decoded j^e VBV is a hypothetical decoder which is conceptually 

picture. Cannot be used as an anchor picture. connected to the output of an encoder. Coded data is placed 

vbv__Buffer: \^rtual Buffer Verifier (VBV) — a conceptual in the buffer at the constant bit rate that is being used, and 

decoder channel buffer that shall not overflow or under- is removed accorfing to which data has been in the buffer for 

flow. the longest period of time. The bitstream produced by an 

R_t: Transport stream data rate. encoder or editor must not cause the VBV to either overflow 
The IPU 400 can process a main transport stream that 65 or underflow. The MSB 415 and ISB 420 output the same 

includes one or more programs (e.g., channels). If the main transport stream which appeared at the input after parsing as 

stream carries only a single program, the IPU inserts the discussed. 
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At the time T_out, the operation of the MSP and ISP is 
similar to the T_in point, except that the main stream and 
insertion stream are interchanged. That is, after the insertion 
stream has been inserted into the main stream, the main 
stream must be coupled with the end of the insertion stream. 
To accomplish this, as soon as T_out is detected, the ISP 
will parse the insertion stream to locate the transport packet 
with the next, or most recent previous (if still available), 
anchor picture start code. When an I or P picture start code 
is found in the insertion stream transport packets, the ISP 
420 sends the transport packet which contains the anchor 
picture start code (e.g., the last packet of the insertioa 
stream) to the syntax processor 470 for processing. Also at 
this time, the MSP 415 sends the first packet of the remain- 
der of the main stream to the syntax processor 470 for 
processing. In this manner, the transition from the end of the 
insertion stream to die beginning of the remainder of the 
main stream can be performed seamlessly. 

The video buffer manager 425 checks for the fullness of 
the video buffer according to its inputs, PCR, PCR', DTS, 
DTS', and video data rates R__v and R_v'. In case of a 
potential buffer overflow, it instructs the null packet genera- 
tor 430 to generate L null packets and insert the packets into 
the output stream. The number of packets to generate is 
stored in a register 

The syntax processor 470, which can communicate with 
the MSB 480, DB 485 and ISB 490 of the output buffer 475, 
processes the last packet before the splicing point and the 
first packet after the splicing point to provide a seamless 
transition that is MPEG compliant. At T_in, the syntax 
processor 470 reads the last transport packet from the main 
stream and the first packet from the insertion stream. It 
checks the syntax of the packets and repairs them, if 
necessary, so that they will be MPEG compliant, as will be 
discussed below in greater detail. At T_out, the syntax 
processor 470 operates in the similar way except that the 
main stream and insertion stream are interchanged. That is, 
the syntax processor 470 will read the last transport packet 
from the insertion stream and the first packet from the main 
stream, and then check the syntax of the packets and repair 
them, if necessary. Thus, the syntax processor 470 receives 
unfixed packets and addresses for the unfixed packets, and 
outputs fixed packets. 

In the event of potential buffer overflow, the null packet 
generator 430 is instmcted by the video buffer manager to 
generate null packets and insert them to the output. Thus, the 
null packet generator 430 receives a signal to generate null 
packets, and the number L of packets to generate, and 
outputs null packets. 

It is desired that the PIDs of the resulting output stream do 
not change after the insertion. Accordingly, a PSI/PID 
replacer 435 is provided to replace the PSI tables and PIDs 
of the inserted stream with those of the main stream. The 
PSI/PID replacer 435 receives transport packets with the old 
PSI/PID, new PSI tables, and a PID conversion table, and 
outputs transport packets with the PSI/PID replaced. 

The output buffer 475 is divided into three parts. The Data 
Buffer (DB) 485 is used to store common data such as PSI 
and null packeu. The Main Stream Buffer (MSB) 480 and 
Insertion Stream Buffer (ISB) 490 are used to store the main 
stream and insertion stream, respectively. 

A buffer controller 465 is used to coordinate the read and 
write operations of the DB, MSB, and ISB. It also performs 
addressing and output scheduUng of each transport packet 
stored in the MSB, ISB and DB. 

A group of registers (not shown) is used in the system for 
storing various parameters such as packet addresses and N, 
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the number of null packets. A map of registers which may be 
used in accordance with the present invention is given in 
Table 1, below. It should be appreciated that Table 1 is an 
example only, and any other suitable map could be used. In 
Table 1, the first column indicates the register index, the 
second column indicates the number of bits, the third 
column indicates whether read (R) and/or write (W) capa- 
bility is required, and the fourth column describes the 
function of the register location. 

TABLE 1 



20 



25 



35 



50 



55 



60 



65 



Index 


BiU 


R/W Description 


1 


7:0 


R,W Read address for main stream 


2 


7:0 


R,W Read address for main stream 


3 


7:0 


R,W Read address for main stream 


4 


7:0 


R,W Read address for main stream 


5 


7:0 


R,W Write address for main stream 


6 


7:0 


R,W Write address for main stream 


7 


7:0 


R,W Write address for main stream 


8 


7:0 


R,W Write address for main stream 


9 


7:0 


R,W Read address for insertion stream 


10 


7:0 


R,W Read address for insertion stream 


11 


7:0 


R,W Read address for insertion stream 


12 


7:0 


R,W Read address for insertion stream 


13 


7:0 


R,W Write address for insertion stream 


14 


7:0 


R,W Write address for insertion stream 


15 


7:0 


R,W Write address for insertion stream 


16 


7:0 


R,W Write address for insertion stream 


17 


7:0 


R,W PCR of current stream 


18 


7:0 


R,W PCR of current stream 


19 


7:0 


R,W PCR of current stream 


20 


7:0 


R,W PCR of current stream 


21 


7:0 


R,W PCR of current stream 


22 


7:0 


R,W PCR of current stream 


23 


7:0 


R,W DTS of current stream 


24 


7:0 


R,W DTS of current stream 


25 


7:0 


R,W DTS of current stream 


26 


7:0 


R,W DTS of current stream 


27 


7:0 


R,W DTS of current stream 


28 


7:0 


R,W Address for PAT 


29 


7:0 


R,W Address for PAT 


30 


7:0 


R.W Address for PAT 


31 


7:0 


R,W Address for PAT 


32 


7:0 


R.W Size of PAT in number of packets 


33 


7:0 


R,W Address for PMT 


34 


7:0 


R,W Address for PMT 


35 


7:0 


R,W Address for PMT 


36 


7:0 


R,W Address for PMT 


37 


7:0 


R,W Size of PMT in number of packets 


3S 




Interrupt register. 




7 


R SS, Splicing signal. 1: SS is detected; 0: splicing 
processing done 




6 


R MSD, 1: Main stream done 




5 


R ISD, 1: Insertion stream done 




4 


R NPD, 1: Null packets done 




3 


R APF, 1 : Anchor picture found 




2:0 


N/A Reserved 


39 


7:0 


R,W Number of Null packets to generate 


40 


7:0 


R,W Stream output read address 


41 


7:0 


R,W Stream output read address 


42 


7:0 


R,W Stream output read address 


43 


7:0 


R,W Stream output read address 


44 


7:0 


R,W Main video elementary stream rate 


45 


7:0 


R,W Main video elementary stream rate 


46 


7:0 


R,W Main video elementary stream rate 


47 


7:0 


R,W Insertion video elementary stream rate 


48 


7:0 


R,W Insertion video elementary stream rate 


49 


7:0 


R,W Insertion video elementary stream rate 


50 


7:0 


R,W PIDl of main stream 


51 


7:3 


R,W PIDl of main stream 


51 


7:0 


R,W PID2 of main stream 


52 


7:3 


R.W PID2 of main stream 


53 


7:0 


R.W PID3 of main stream 


54 


7:3 


R,W PID3 of main stream 


55 


7:0 


R,W PID4 of main stream 


56 


7:3 


R,W PID4 of main stream 


57 


7:0 


R,W PIDl of insertion stream 
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Index 


Bits 


K/W Description 


58 


7:3 


R,W P[D1 of insertion stream 


59 


7:0 


R,W P[D2 of insertion stream 


60 


7:3 


R,W P[D2 of insertion stream 


61 


7:0 


R,W PtD3 of insertion stream 


62 


7:3 


R,W P[D3 of insertion stream 


63 


7:0 


R,W P[D4 of insertion stream 


64 


7:3 


R,W PID4 of insertion stream 


65-68 


7:0 


R,W Read address for PIDl of insertion stream 


69-72 


7:0 


R,W Write address for PIDl of insertion stieam 


73-76 


7:0 


R,W Read address for PID2 of insertion stream 


77^0 


7:0 


R,W Write address for PID2 of insertion stream 


81-84 


7:0 


R,W Read address for PID3 of insertion stream 


85-88 


7:0 


R,W Write address for PID3 of insertion stream 


89-92 


7:0 


R,W Read address for PID4 of insertion stream 


93-96 


7:0 


R,W Write address for PID4 of insertion stream 
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Since BO=decoding_delay*R_v, we have: 

TABLE 1 -continued T_pad^decodjng__delay-vbv_buffer_size/R_v'. 

Since decodmg_delay<vbv_buffer/R_v, to simplify the 
computation, T__pad can be written as: 
^ T_pad^vbv_buffer_size* (1/R_v-1/R_v'). 

For example, if R_vo4 Mbps and R_v'=8 Mbps, then the 
padding time will be: 

T_pad=1835008 * (y4-y8)=0.23 sec. 
However, this does not mean that the viewer will detect a 
discontinuity of 0.23 second. In fact, there will be no visible 
discontinuity when the data is displayed on a television 
screen since the 0.23 second delay only flushes out part of 
the data in the video decoding buffer. After 0.23 second, the 
data from the insertion stream will fill the buffer while the 
decoder is still decoding the data from the main stream. As 
long as the time to decode the remaining data in the video 
decoding buffer is greater or equal to (vbv_delay_of_„ 
The complexity of the IPU largely depends on the video first_^icture— l/picture„rate) of the insertion stream, there 
buffer management scheme. Two implementations of a ^^^^ ^ decoding discontinuity, 
video buffer management scheme in accordance with the Furthermore, at T__out, T_pad is computed as: 

present invention are presented. First, in a simplified T_pad^decoding_delay-vbv_buffer_size/R_v, or 
version, the number L of null packets for padding the output simplified to: 

stream to prevent buffer overflow are provided only accord- T Dad^vbv_buffer_size* (1/R_v'-1/R_v) 

ing to the video elementary stream data rates of the ma^^ ^h^ ^^^^^^ ^^^^^ ^ ^^^^^^^^^ ^e 

insertion stream, R_v and R_v , respectively. At T_in, the computed as* 

number of packets to pad with null data is computed as: ^ a ^ u 

L=vbv_buffer_size * (1/R_v-1/R_v') * R_t/(188*8). 1:77"^.?, ^-'^(^°^*^)- . ^ .i. r 

At T_out, the number of packets to pad is computed as: „ ^ ^^/f f^^^f J^^ processing flow of the Insertion 

I^vbv_buffer_size * (1/R_v'-1/R_v) * R_t/(188*8). Processing Unit of FIG. 4 m accordance with the present 
The advantage of this scheme is a simplified mvenUon. Note that flie steps of FIG. 5 are shown as 
implementation, and there is no need to track the PGR and occurrmg m a sequential maimer for clanty, but many of the 
DTS of the stream. The disadvantages are that padding is steps may occur concurrently and/or sequentially. At block 
larger than needed, and decoding or display discontinuities ^02, the IPU outputs the mam transport stream from the 
may result. Note that padding is required only when the "^^i" stream buffer (MSB) 480. The IPU is essentially m a 
insertion stream has a higher data rate than the main stream. bypass mode at this time since the insertion stream has not 

In a second, more complete version of the video buffer ^^C" inserted. At block 506, the mam stream parser 

management scheme, padding is used according to a decod- P^^^ses the mam stream to locate the splicing signal T_m. 
ing delay of the main and insertion stream and the video N^te that T_Jn need not be carried in the main stream, but 
elementary stream rates. The decoding delay is the differ- ^ay be provided locally, for example, at a cable system 
ence between the time the first byte of a picture is received deadend. When T_in is detected, the IPU continues to 
and the time when decoding is completed. With this scheme, output the mam transport stream from the mam stream 
at T_Jn, the number of packets to pad is computed as: b^^^^- block 508, the main stream parser parses the main 

I^(decodin&_delay-vbv_buffer_size/R_v') * R_t/ f^^"^^ ^^^^^^ closest packet with an anchor picture 
A gg*g\ ^ ^ (e.g., I or P picture) start code and passes that packet to the 

At T_out, the number of packets to pad is computed as: « syntax processor 470. TTiis packet will be the last packet of 

J J. J, L ujT /n \ *nw the mam stream. To ensure that the resulting data Stream is 

L-(decoding delay-vbv buffer size/R v) * R if v,nc^ i- <^ j * r *u * r 

n RR*R\ ~ ~ ~ ~ MPEG comphant, no data from the next frame or sequence 

J \ . i_ J- ^ .L.J of frames may be included in this last main stream packet. 

The advantages of this second embodiment are that pad- .... i ei^i ,v . .j j j 

... j^, jjj.u' u f At block 512, the syntax processor adds a sequence end code 

dmg IS used only as needed, and there is no chance of a V i , /lu ■ * -rn! a 
J ^j. J. 1 J. /. J . jj. A 50 field to the last packet of the mam stream. The sequence end 

decoding or display discontinmty caused by padding. A , , . a k'u-j-*«t, 

. , • *u . .u J J 1 /u * -1 code is a twenty-four bit code which indicates the end 01 a 

dmdvantage ^ that the decodmg delay must be computed, ^ of piciures. At block 514. the PSI/PID replacer 435 

and therefore the PCR and DTS of the data stream must be j^^^ .^^j^^ ^J^^ 

retneved and decoded. This reqmres additional hardware a* i_i i tiir *t. * *u c * 

. ^ At block 516, the syntax processor processes the first 

anu cxTicnsc ' ^ * * 
Tir*u * f .u u u *L II*- c *u 55 packet of the insertion stream (e.g., the packet which con- 

With either of the above schemes, the calculation of the f^. ^ ^ c« iL* orT,, ^.t. u»f^r^ iu^ 

, r 11 JJ- t . t . J • tains the sequence start code) so that any data beiore the 

number of null padding packets can be computed using the .u:, „/^u«t th.t ;c^>^™;„,. f,^,^ tK^ 

£„.,-r. J ^ sequence start code m this packet that is commg irom the 

following definitions and assumptions. • . • i j -.u * iar l * ■ *u j 

r\ f. . insertion stream is replaced with stuffing bytes m the adap- 

w."/' J J. ^ . t J i. lation field. If the adaptation field does not exist, it is created. 

BO: Video decoding buffer size at the end of old stream. ^^^^^^.^ ^^^^^^^ ^^^^^^ p^S ^^^^^^ ^ 

vbv_buffer size: 1.75 Mb or 1835008 bit modified to ensure that the output stream is MPEG compU- 

T_pad: Duration of null padding bits. ant. The syntax processor also sets the discontinuity indica- 

At T_in point: tors of the insertion stream in ISB for all the packets before 

BO-R_v * T_pad+(R_v'-R_v)*(decoding_delay-T_ the PGR packet to "1". 

pad) ^ vbv_buffer_size; and 65 At block 518, the video buffer manager 425 calculates the 

T_pad^decoding_delay* (l-R_v/R_v')-(vbv_ number, N, of null packets to pad. At block 520, at the end 

buffer_size-BO)/R_v'. of the main stream, which is designated as the position 
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sp_in, an interrupt signal, Main Stream Done (MSD), is p.m., T_oute8:01 p.m., then T_in=8:20 p.m., T_out=8:21 

generated. At block 522, after receiving the MSD signal, the p.m., and finally T_in-8:59 p.m., T_oiit-9:00 p.m. Other 

IPU reads the null packets from the data bufiFer 435 and variations are possible, of course. For example, a prere- 

writes the null packets to the output stream. At block 524, at corded series of commercials may be assembled. In this 

the end of the null packets, an interrupt signal. Null Packets 5 case, the beginning of the first commercial will correspond 

Done (NPD), is generated. to T_in, and the end of the last commercial may correspond 

At block 526, after receiving the NPD signal, the system to T_out. Alternatively, the network program may include 

begins to output data from the insertion stream buffer 490 at one or more commercials already in the main transport 

a position which is designated sp_in'. At the same time, the stream. In this case, the present invention may be used to 

MSP reads from the main stream and puts a new sequence 10 replace selected ones of the main stream commercials, or to 

in the MSB. remove selected ones of the commercials without replace - 

At block 530, when T__out is detected, the processing ment. Note that the latter case may not be possible in 

continues at block 540. Otherwise, the system is in a waiting real-time. 

mode until T_out is received. At this time, the system in order to implement the processing flow of FIG. 5, the 
continues to output data from the ISB. Generally, T_out 15 structure of a packetized data stream must be examined in 
may be provided locally, for example, by a cable system greater detail. In a packetized digital data stream, typically 
headend. However, it may be preferable for T_in and T_out the packets carrying the compressed video data will be 
to be provided in the main stream so that the cable headend multiplexed with other packets, e.g., carrying corresponding 
is not tasked with managing the time and duration of the audio data and control information necessary to reconstruct 
insertion. Moreover, the gap in the main stream in which the 20 a television signal. One standard for transporting digital 
insertion stream is to be provided will not typically be television signals in this manner is the MPEG-2 standard, 
controllable by the cable headend. At block 540, the ISP detailsof which can found in document AVC-491, version 1, 
parses the insertion stream for the packet with an anchor April, 1993, published by the Telecommunications Stan- 
picture start code and passes that packet to the syntax dardization Sector, Study Group 15, Experts Group 4ArM- 
processor. This will be the last packet of the insertion stream. 25 Video Coding of the International Organization for 
The syntax processor processes this last packet of the Standardization, ISO-IE C/JTC1/SC29AVG 11 entitled 
insertion stream so that there is no data from the next frame "Coded Representation of Picture and Audio Information," 
or sequence of frames included in the packet. Thus, the incorporated herein by reference; ISO/IEC 13818-2, Mar. 
resulting data stream will be MPEG compliant. At block 25, 1994, entitled "Generic Coding of Moving Pictures and 
544, the syntax processor adds a sequence end code field to 30 Associated Audio," incorporated herein by reference; and 
the last packet of the insertion stream. ISO/IEC 13818-1, Apr. 27, 1995, entiUed "Coding of Audio, 

At block 546, the syntax processor processes the first Picture, Multimedia and Hypermedia Information," incor- 

packel of the main stream (which contains the sequence start porated herein by reference. Further details of the video 

code) so that any data before the sequence start code in this syntax and semantics for MPEG-2 video can be found in 

packet that is coming from main stream is replaced with 35 International Organization for Standardization document 

zeros. The packet's transport header and PES header are also ISO/IEC 11172-6 dated Apr. 2, 1993 and entitled "Revised 

modified to ensure that lie output stream is MPEG comph- Syntax and Seriiantics for MPEG-2 Video," also incorpo- 

ant. The syntax processor also sets the discontinuity indica- rated herein by reference. Also of interest, and incorporated 

tors of the main stream in the MSB for all the packets before herein by reference, is document MC68VDP/D, a prelimi- 

the PGR packet to "1". ^o nary data sheet entitled "MPEG-2/DCII Video Decompres- 

At block 548, the video buffer manager calculates the sion Processor," ©Motorola Microprocessor and Memory 

number of nuU packets to pad. At block 550, at the end of Technologies Group, 1994 which describes a video decom- 

IS, which is designated sprout*, an interrupt signal, Inser- pression processor using the MPEG-2 and DigiCipher®!! 

tion Stream Done (ISD), is generated. At block 552, after standards. 

receiving the ISD signal, the system reads the null packets 45 In the MPEG-2 system (and the similar DigiCipher® II 

from the data buffer and writes to the output stream. At block system proprietary to General Instrument Corporation, the 

554, at the end of the null packets, an interrupt signal, Null assignee hereof) a transport stream, or transport multiplex is 

Packets Done (NPD), is generated. At block 556, after made up of a contiguous set of fixed length packets. Each 

receiving the NPD signal, the system begins to read from the packet is 188 total bytes in length, with the first four of those 

MSB at a point which is designated sp_out. Thus, at this 50 bytes being defined as the packet header. The payload 

time, the insertion stream ends and the next portion of the portion of each packet is thus normally 184 bytes. However, 

main stream begins to be output. At the same time, the ISP a variable length adaptation field may be provided to extend 

reads from the insertion stream and puts a new sequence in the header, when required. When an adaptation field is 

the ISB for fiiture use. The process continues at block 506, present, the payload portion of the packet will be corre- 

where the MSP parses the main stream for the next splicing 55 spondingly shorter. 

signal, T_in. Various timing and identification information is provided 
In practice, the invention is particularly suitable for insert- in different portions of the transport stream. These include a 
ing commercial messages into one or more network telcvi- packet identifier (PID) found in the transport header of each 
sion programs. For example, often times a network program transport packet to provide a reference number for identi- 
is transmitted via satellite to local cable system operators. 60 fying the transport packets carrying a specific service com- 
The cable system operator has the task of inserting com- ponent. This number is included in a service definition or 
mercials from local businesses into the main stream. In this "service map" used by the receiver to identify those trans- 
case, it may be desirable to provide commercials, for port packets required to reconstruct a television program 
example, every twenty minutes. Furlheraiore, assume one signal. The PID may also be referenced for various groom- 
commercial is inserted, and that the commercial has a 65 ing and remultiplexing functions. In the case of video, audio 
duration of one minute. Then, for a network program which or isochronous control data, the stream of packets labeled 
runs from 8:00 p.m. to 9:00 p.m., we may have T_in*8:00 with a single PID represents a single video, audio or 
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isochronous data service elementary stream, respectively. 
Each type of packet will have a different PID identifying the 
packet type. 

Timing information carried by the transport stream 
includes a program clock reference (PCR) which effectively 
represents a sample of the system time clock (STC) time 
base that underlies the service composed of the PIDs refer- 
enced in the service map. The PID carrying the packet with 
the PCR is also referenced in the service map. The video, 
audio and isochronous data components of a service are 
locked through a defined relationship to the system time 
clock. The PCR serves to define the transport rate, in the 
sense that between any two successive PCRs in one PID, the 
transport rate is constant and nominally equal to the system 
time clock rate times the ratio of the total number of 
transport bytes between the PCRs divided by the difference 
in the PCRs in units of system time clock ticks. 

The timing information carried by the transport stream 
also includes time stamps for the commencement of decod- 
ing and presentation of data for display. The presentation 
time stamp (PTS) is used for service component acquisition 
and also for evaluating whether timing and buffer control are 
operating properly at the decoder. The decoder time stamp 
(DTS) is used to indicate when the decoder should start to 
decode the first access unit (e.g., video frame) that starts in 
the payload of a packetized elementary stream (PES) packet 
whose header includes the DTS. A packetized elementary 
stream is a data stream composed of end-to-end PES packets 
which have variable length and are typically far longer than 
a fixed length transport packet. TTius, a PES packet is 
typically composed of data from a plurality of transport 
packets, 

FIGS. 6a to 6c are diagrammatic illustrations showing 
how variable length PES packets are reorganized into fixed 
length transport packets for use in providing a transport 
multiplex for transmission. FIG. 6a illustrates a portion of a 
packetized elementary stream carrying successive PES 
packets, each having a header (PES-HDR) 672 and a PES 
payload 674. The PES packets 670 are of variable length. 
PES packets are typically several thousand bytes in length. 
They are required to be aligned in such a manner that, when 
divided into transport packet payloads, the first byte of every 
PES header is located in the first payload position of some 
transport packet. For any transport packet carrying the 
aligned PES header, a "payload unit start indicator'* will be 
set in the transport header for the transport packet. In the 
MPEG-2 and DigiCiphcro® II systems, the PES format is 
used for all service components that are inherently synchro- 
nous. More particularly, video, audio and isochronous data 
components are carried as packetized elementary streams, 
and the PES headers 672 will carry various information 
necessary to define the payload, including a packet start code 
prefix, a stream identification, and a PES packet length. 

The header may also contain a presentation time stamp 
(PTS) or decode time stamp (DTS). The PTS is a field which 
indicates the value that corresponding bytes of the decoder 
system time clock reference should have when the first 
presentation unit (Le., video frame, audio sync frame, iso- 
chronous data access unit) whose access unit starts some- 
where in the payload of this PES packet is presented. For 
video, an access unit starts if the first byte of the picture start 
code is present in the payload of the PES packet. For audio, 
an access unit starts if the first byte of the sync word is 
present in the payload of this PES packet. For isochronous 
data, an access unit starts if the first byte of the data header 
is present in the payload of this PES packet. The PTS field 
is used for service component acquisition, and also for 



evaluating whether timing and buffer control are operating 
properly at the decoder. 

The DTS is a field indicating what value corresponding 
bits of the decoder system time clock reference should have 

s when the decoder starts to decode the first access unit that 
starts somewhere in the payload of this PES packet. The PTS 
and DTS differ only for video, and only in the case of the 
I-framc and the P-frames transmitted with B -frames. 
The PES payload contains the information data that is 

10 desired to be transmitted to a receiver. Thus, the payload 
includes all of the video, audio and control information 
necessary for the receiver to decode and reconstruct, e.g., a 
digital television signal. 

In order to meet the requirements of robustness and 

15 simplicity, a fixed packet length approach is preferred to the 
variable length PES packets. Thus, as illustrated in FIG. 6b, 
the packet elementary stream containing the PES packets 
670 is reconfigured into a stream of fixed length transport 
packets 680. The transport packets DIustrated in FIG. 6b all 

20 correspond to the same service component, such as the video 
component of a digital television transmission. In the 
MPEG-2 and DigiCipher® II embodiments, each packet is 
188 total bytes in length, with the first four bytes comprising 
a transport packet header (TP HDR) 682. The payload 

25 portion 684 of each packet 680 is thus normally 184 bytes. 
However, an adaptation field mechanism is present, as 
illustrated by transport packet 680', to extend the header 
when required. The adaptation field 686 provides additional 
information which is not required for every transport packet. 

30 The adaptation field (ADPT FIELD) 686 extends the regular 
transport header 682 at the expense of payload 684, which 
will be less than 184 bytes whenever the adaptation is 
provided. The adaptation field 686 is of variable length, 
depending on the information it contains. Typically, the 

35 adaptation field will support additional information for time 
base recovery and other functions, and also provides a 
mechanism for padding the payload when it does not occupy 
the full 184 bytes. Such padding can be used, for example, 
to make a variable rate video packetized elementary stream 

40 into a constant rate transport stream. 

As indicated in FIG. 6b, the transport header of each 
transport packet includes the PID which identifies the par- 
ticular service component carried by the transport packet. 
The PCR will be carried by an adaptation field to provide 

45 timing information for a desired service. At a receiver, the 
PCR for the desired service is detected from the adaptation 
field. The PIDs of the transport packets will then be moni- 
tored in accordance with the timing established by the PCR 
to recover those transport packets carrying a particular 

50 component of the service to be processed. 

Transport packets from various service components are 
multiplexed into a transport multiplex 690 as illustrated in 
FIG. 6c. The transport multiplex will carry interspersed 
packets from each of the different components (e.g., video, 

55 audio and control) necessary to reconstruct a service at the 
receiver. In the illustrative transport multiplex shown in FIG. 
6c, video transport packets 680 (A^, A2, A3 . . . ) are followed 
by audio components 692 (B^, B^, B3 . . . ) which, in turn, 
are followed by control component packets 694 (C^, Cj, 

60 C3 . . . ). 

With the foregoing in mind, the operation of the syntax 
processor 470 of the IPU 400 in fixing the packets of the 
main stream or the insertion can now be discussed. First, the 
process of blocks 508 and 540 will be discussed, wherein the 
65 last packet of the main or insertion stream, respectively, 
before the splicing point, is processed to maintain compli- 
ance with an MPEG or similar communication protocol. The 
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Splicing point is the boundary between the main and inser- 
tion stream packets. This corresponds to the point between 
sp_in of the main stream and sp_in' of the insertion stream 
when the output stream transitions from the main to the 
insertion stream, or to the point between sp__out' of the S 
insertion stream and sp_out of the main stream when the 
output stream transitions from the insertion to the main 
stream. 

Generally, the last packet of the data stream before the 
splicing point has to be processed since the transport packet lO 
boundary may not be the same as the picture boundary. This 
last packet will be referred to as a pre-splicing data packet. 
In this case, the pre-splicing packet wiQ contain part of the 
data from the next (anchor) frame. The pre-sphcing packet 
can be fixed by discarding the data from the next frame and is 
stuffing the same amount of bytes to the adaptation field of 
the last packet, where it is understood that stuffing bytes are 
simply dummy bytes of data. If an adaptation field does not 
exist in the last packet, it can be created. Note that after 
fixing the information contained in the adaptation__field and 20 
pcs_hdr, including adaptation„fi6ld__l6ngth, payload_ 
unit_start_indicator, pes_length, and other parameters, 
may be changed. However, this is not expected to result in 
any visible discontinuity or artifacts to the viewer when the 
data is displayed. 25 

Processing of the pre-splicing packet is treated differently 
depending on whether the packet has an adaptation field and 
a PES header, and further depending on the location of data 
fields in the packet. FIGS. la~ld show a pre-splicing data 
packet having an adaptation field and PES header before and 30 
after processing in accordance with the present invention. 

In FIG. 7fl, the packet, shown generally before processing 
at 700, includes a transport header 701, an adaptation field 
702 carrying K bytes, a first data field 703, a PES header 
(pes_hdr) 704, a second data field 705, a picture start code 35 
706 carrying four bytes, and a third data field 707 carrying 
M bytes. In this case, it can be seen that there is data carried 
in the packet 700 between the adaptation_Jield 702 and the 
pes_hdr 704, and between the pes_hdr 704 and the pic_ 
start_code 706. 40 

Moreover, since the pic_start_code 706 defines the start 
of a new picture or frame, it can be seen that the third data 
field 707 carries data of the new firame. Thus, in accordance 
with the present invention, the packet 700 is processed by 
discarding the data of the pic_start_code 706 and the 45 
associated third data field 707, and stuffing 4+M dummy 
bytes in the adaptation field 702. This results in the pro- 
cessed packet 710 which includes the adaptation field 712, 
and which terminates with the second data field 705. The 
packet 710 includes data from only one picture and does not 50 
require the next adjacent packet to maintain continuity. 

Note that in FIGS. 7-11, the relative width of a packet or 
a field thereof does not necessarily indicate the amount of 
data carried in the field or the packet. 

In FIG. Iby the unprocessed packet is shown generally at 55 
720, and the processed packet is shown generally at 730. 
Here, there is data between the adaplation_field 702 and the 
pes_hdr 704, but not between the pes_hdr 704 and the 
pic_start_code 706. In accordance with the present 
invention, the packet 720 is processed by discarding the data 60 
of the pes_hdr 704, pic_start_code 706 and the third data 
field 707, and stuffing N+4+M dummy bytes in the adapta- 
tion field 702. This results in the processed packet 730 which 
includes the adaptation field 732, and which terminates with 
the first data field 703. 65 

In FIG. 7c, the unprocessed packet is shown generally at 
740, and the processed packet is shown generally at 750. 



Here, there is data between the pes_Jidr 704 and the 
pic__start_code 706, but not between the adaptation_field 
702 and the pes_hdr 704. In accordance with the present 
invention, the packet 740 is processed by discarding the data 
of the pic_start_code 706 and the third data field 707, and 
stuffing 4+M dummy bytes in the adaptation field 702. This 
results in the processed packet 750 which includes the 
adaptation field 752, and which terminates with the second 
data field 705. 

In FIG. Id, the unprocessed packet is shown generally at 
760. Here, there is no data field between the pes„hdr 704 

and the pic_5tart__code 706, or between the adaptation 

field 702 and the pes_hdr 704, In accordance with the 
present invention, as shown at 770, the entire packet 760 is 
not transmitted since there would be no data fields remaining 
after discarding the third data field 707. 

FIGS. 8a and show a pre-splicing data packet having 
an adaptation field but no PES header before and after 
processing in accordance with the present invention. In FIG. 
8fl, the unprocessed packet is shown generally at 800, and 
the processed packet is shown generally at 810. Here, there 
is data between the adaptation field 802 and the pic__start_ 
code 804. In accordance with the present invention, the 
packet 800 is processed by discarding the data of the 
pic_start_code 804 and the second data field 805, and 
stuffing 4+M dummy bytes in the adaptation field 802. This 
results in the processed packet 810 which includes the 
adaptation field 812, and which terminates with the first data 
field 803. 

In FIG. 8/>, the unprocessed packet is shown generally at 
820. Here, there is no data field between the adaptation field 
802 and the pic_start„cod6 804. In accordance with the 
present invention, as shown at 830, the entire packet 820 is 
not transmitted since there would be no data fields remaining 
after discarding the second data field 805. 

FIGS. 9a-9d show a pre-splicing data packet having no 
adaptation field but with a PES header before and after 
processing in accordance with the present invention. In this 
case, an adaptation field is created which carries the dummy 
stuffing bits which account for the discarded fields. In FIG. 
9a, the packet, shown generally before processing at 900, 
includes a transport header 901, a first data field 902, a PES 
header 903, a second data field 904, a picture start code 905 
carrying four bytes and a third data field 906 carrying M 
bytes. In this case, data is canied between the tp_hdr 901 
and the pes__hdr 903, and between the pes_hdr 903 and the 
pic_start_code 905. In accordance with the present inven- 
tion the packet 900 is processed by discarding the data of the 
pic_start_code 905 and the third data field 906, and creat- 
ing an adaptation field 912 with 4+M dummy bytes as shown 
in the processed packet 910. 

In FIG. 9b, the unprocessed packet is shown generally at 
920, and the processed packet is shown generally at 930. 
Here, there is data between the tp_hdr 901 and the pes_hdr 
903, but not between the pes_hdr 903 and the pic_start_ 
code 905. In accordance with the present invention, the 
packet 920 is processed by discarding the data of the 
pes_hdr 903, pic_start_cod6 905, and the third data field 
906, and creating an adaptation field 932 with N+4+M 
dummy bytes, as shown in the processed packet 930. 

In FIG. 9c, the unprocessed packet is shown generally at 
940, and the processed packet is shown generally at 950. 
Here, there is data between the pes_hdr 903 and the 
pic_start__code 905, but not between the tp_hdr 901 and 
the pes_hdr 903. In accordance with the present invention, 
the packet 940 is processed by discarding the data of the 
pic_start_code 905 and the third data field 906, and creat- 
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ing an adaptation field 952 with 4+M dummy bytes, as 
shown in the processed packet 950. 

In FIG, 9d, the unprocessed packet is shown generally at 
960. Here, there is no data field between the tp_hdr 901 and 
the pes_hdr 903, or between the pes_hdr 903 and the 5 
pic_start_code 905. In accordance with the present 
invention, as shown at 970, the entire packet 960 is not 
transmitted since there would be no data fields remaining 
after discarding the third data field 906. 

FIGS. lOfl and 106 show a pre -splicing data packet having 
no adaptation field or PES header before and after process- 
ing in accordance with the present invention. In this case, an 
adaptation field is created which carries the dummy stuffing 
bits which account for the discarded fields. In FIG. lOa, the 
unprocessed packet is shown generally at 1000, and the 
processed packet is shown generally at 1010. Here, there is 
data between the tp_hdr 1001 and the pic__start_code 
1003. In accordance with the present invention, the packet 
1000 is processed by discarding the data of the pic_start_ 
code 1003 and the second data field 1004, and creating an 
adaptation field 1012 with 4+M dummy bytes, as shown in 20 
the processed packet 1010. 

In FIG. lOfc, the unprocessed packet is shown generally at 
1020. Here, there is no data field between the tp_hdr 1001 
and the pic_start_code 1003. In accordance with the 
present invention, as shown at 1030, the entire packet 1020 25 
is not transmitted since there would be no data fields 
remaining after discarding the second data field 1004. 

Now, the process of blocks 516 and 546 will be discussed, 
wherein the first packet of the main stream after the second 
splicing point (e.g., sp_out), is processed to maintain com- 30 
pliance with the MPEG or similar communication protocol. 
This first packet will be referred to as a post-splicing data 
packet. As with the pre-splicing packet, processing of the 
post-splicing packet is treated differently depending on 
whether the packet has an adaptation field and a PES header, 35 
and further depending on the location of data fields in the 
packet. In particular, the first post-splicing packet must be 
processed by the syntax processor 470 when the splicing 
point does not correspond exactly to a picture boundary. In 
this case, the post-spUcing packet may contain part of the 40 
data from a previous picture or sequence of pictures. 

In accordance with the present invention, the post- 
splicing packet is fixed by discarding the data from the 
previous sequence and stuffing a compensating number of 
dummy bytes to the adaptation field of the post-splicing 45 
packet. Furthermore, an adaptation field is created if it does 
not already exist. Moreover, as with the processing of the 
pre-splicing packet, the information contained in the 
adaptation_Jield and pes_hdr, including adaptation_Jield_ 
length, payload_unit_start_indicator, pes_length, and so 
other parameters, may be changed, but this is no expected to 
result in any visible discontinuity or artifacts to the viewer 
when the data is displayed. 

FIGS, lla-lld show a post -splicing data packet having 
an adaptation field and PES header before and after pro- 55 
cessing in accordance with the present invention. In FIG. 
Ufl, the packet, shown generally before processing at 1100, 
includes a transport header 1101, an adaptation field 1102 
carrying K bytes, a first data field 1103 carrying N bytes, a 
PES header, pes_hdr 1104, a second data field 1105 carrying 60 
M bytes, a sequence start code 1106 and a third data field 
1107. In this case, it can be seen that there is data carried 
between the adaptation_field 1102 and the pes_hdr 1104, 
and between the pes_hdr 1104 and the seq^tart_code 

1106. 65 

Moreover, the seq_start_code 1106 defines the start of a 
new sequence of pictures, and the first data field 1103 and 



the second data field 1105 carry data of a picture from a 
previous sequence. Thus, in accordance with the present 
invention the packet 1100 is processed by discarding the first 
data field 110 and the second data field 1105, and stuffing 
N+M dummy bytes in the adaptation field 1102. This results 
in the processed packet 1110 which includes the adaptation 
field 1112. The packet 1110 includes data from only one 
sequence of pictures and does not require the previous 
adjacent packet to maintain continuity. 

In FIG. Ilby the unprocessed packet is shown generally at 
1120, and the processed packet is shown generally at 1130. 
Here, there is data between the adaptation_field 1102 and 
the pes_hdr 1104, but not between the pes„hdr 1104 and 
the seq_start_code 1106. In accordance with the present 
invention, the packet 1120 is processed by discarding the 
first data field 1103, and stuflBng N dummy bytes into the 
adaptation field 1102. This results in the processed packet 
1130 which includes the adaptation field 1132. 

In FIG. 11c, the unprocessed packet is shown generally at 
1140, and the processed packet is shown generally at 1150. 
Here, there is data between the pes„hdr 1104 and the 
seq_start_codc 1106, but not between the adaptation _fi6ld 
1102 and the pes_hdr 1104. In accordance with the present 
invention, the packet 1140 is processed by discarding the 
second data field 1105, and stuffing M dummy bytes in the 
adaptation field 1102. This results in the processed packet 
1150 which includes the adaptation field 1152. 

In FIG. llrf, the unprocessed packet is shown generally at 
1160. Here, there is no data field between the pes_hdr 1104 
and the seq_start_code 1106, or between the adaptation_ 
field 1102 and the pes_hdr 1104. In accordance with the 
present invention, the entire packet 1160 is transmitted 
without modification since there is no data field prior to the 
seq_start_code 1106, 

FIGS. 12fl and 12^? show a post-spUcing data packet 
having an adaptation field but no PES header before and 
after processing in accordance with the present invention. In 
FIG. 12a, the unprocessed packet is shown generally at 
1200, and the processed packet is shown generally at 1210. 
Here, there is data between the adaptation field 1202 and the 
seq_start_code 1204. In accordance with the present 
invention, the packet 1200 is processed by discarding the 
first data field 1203 and stuffing N dummy bytes in the 
adaptation field 1202. This results in the processed packet 
1210 which includes the adaptation field 1212. 

In FIG. 12b, the unprocessed packet is shown generally at 
1220. Here, there is no data field between the adaptation 
field 1202 and the seq_start_codc 1204. In accordance with 
the present invention, the entire packet 1220 is transmitted 
without modification since there is no data field prior to the 
seq_start_code 1204. 

FIGS. 13a-13d show a post-splicing data packet having 
no adaptation field but with a PES header before and after 
processing in accordance with the present invention. In FIG. 
13fl, the packet, shown generally before processing at 1300, 
includes a transport header 1301, a first data field 1302 
carrying N bytes, a PES header 1303, a second data field 
1304 carrying M bytes, a sequence start code 1305 and a 
third data field 1306. In this case, it can be seen that there is 
data carried in the packet 1300 between the tp_hdr 1301 and 
the pes_Jidr 1303, and between the pes_hdr 1303 and the 
seq_start_code 1305. In accordance with the present inven- 
tion the packet 1300 is processed by discarding the first data 
field 1302 and the second data field 1304, and creating an 
adaptation field 1312 with N+M dummy bytes as shown in 
the processed packet 1310. 

In FIG. 12b, the unprocessed packet is shown generally at 
1320, and the processed packet is shown generally at 1330. 
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Here, there is data between the tp_hdr 1301 and the 
pes_hdr 1303, but not between the pes_hdr 1303 and the 
seq_start_code 1305. In accordance with the present 
invention, the packet 1320 is processed by discarding the 
first data field 1302, and creating an adaptation field 1322 
with N dummy bytes, as shown in the processed packet 
1330. 

In FIG. 13c, the unprocessed packet is shown generally at 
1340, and the processed packet is shown generally at 1350. 
Here, there is data between the pes_Jidr 1303 and the 
seq_start_code 1305, but not between the tp_hdr 1301 and 
the pes_Jidr 1303, In accordance with the present invention, 
the packet 1340 is processed by discarding the second data 
field 1304, and creating an adaptation field 1352 with M 
dummy bytes, as shown in the processed packet 1350, 

In FIG. 13d, the unprocessed packet is shown generally at 
1360. Here, there is no data field between the tp _hdr 1301 
and the pes_hdr 1303, or between the pes_hdr 1303 and the 
seq_start_codc 1305. In accordance with the present 
invention, the entire packet 1360 is transmitted without 
modification since there is no data field prior to the S6q__ 
start_code 1305. 

FIGS, 14fl and 14b show a post-splicing data packet 
having no adaptation field or PES header before and after 
processing in accordance with the present invention. In this 
case, an adaptation field is created which carries the dummy 
stuffing bits which account for the discarded fields. In FIG. 
14a, the unprocessed packet is shown generally at 1400, and 
the processed packet is shown generally at 1410. Here, there 
is data between the tp_hdr 1401 and the seq_start_code 
1403. In accordance with the present invention, the packet 
1400 is processed by discarding the first data field 1402, and 
creating an adaptation field 1412 with N dummy bytes, as 
shown in the processed packet 1410. 

In FIG. 14^7, the unprocessed packet is shown generally at 
1420. Here, there is no data field between the tp Jdr 1401 
and the seq_start_code 1403. In accordance with the 
present invention, the entire packet 1420 is transmitted 
without modification since there is no data field prior to the 
seq_start_code 1403. 

A decoder for decoding the output data stream may be 
provided as discussed earlier in connection with FIG. 1. For 
example, the Digital Entertainment Terminal (DET) 168 can 
include a decoder with an associated data buffer and pro- 
cessor. The buffer receives the incoming data stream and 
provides the data to the processor for decoding and other 
processing which is required to provide a signal suitable for 
reproduction on a television. As discussed, the provision of 
null packets in the output data stream will prevent a potential 
buffer overflow at the decoder. 

Accordingly, it can be seen that the present invention 
provides a method and apparatus for splicing compressed 
packetized digital video streams. In particular, a secondary 
packetized data stream, such as a commercial, is spliced 
with a primary packetized data stream, such as a network 
television program. The system does not require the decom- 
pression of the data in the primary data stream, and is 
particularly suitable for use at a cable system headend to 
allow the insertion of commercials from local businesses 
into a nationally broadcast television program. 

Although the invention has been described in connection 
with various specific embodiments, those skilled in the art 
will appreciate that numerous adaptations and modifications 
may be made thereto without departing from the spirit and 
scope of the invention as set forth in the claims. For 
example, it is possible to locate the IPU in the decoder at the 
subscriber's home, thereby providing the subscriber with the 
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capabilities of a in-home digital data mixer such as those 
used at television, radio and recording studios. This would 
allow the subscriber to edit various audio, video and data 
sources. For example, data stored on a DVD or CD-ROM 
could be spliced with a main program for various educa- 
tional and entertainment purposes. 
We claim: 

1. A method for splicing a secondary packetized data 
stream with a primary packetized data stream, comprising 
the steps of: 

providing a start signal indicating a time to initiate said 
splicing; 

determining a pre -splicing packet of said primary stream 
according to said start signal; 

providing an output stream where a first packet of said 
secondary stream is positioned to follow said pre- 
splicing packet; 

determining a post-slicing packet of said primary stream 
which follows said pre -splicing packet; 

discarding data of said pre-splicing packet which is asso- 
ciated with said post-splicing packet; and 

adding an amount of stufi&ng data to said pre-splicing 
packet according to the amount of data discarded. 

2. A method in accordance with claim 1, wherein the 
packets of said primary stream and said secondary stream 
have identifying data associated therewith, comprising the 
further steps of: 

retrieving said identifying data of said primary stream; 
and 

replacing said identifying data of said secondary stream 
with said identifying data of said primary stream. 

3. A method in accordance with claim 1, comprising the 
further steps of: 

providing a number L of null packets in said output stream 
to prevent a buffer overflow at a decoder which receives 
said output stream; and 

inserting said null packets between said pre-splicing 
packet and said first packet; 

wherein said number L is determined according to respec- 
tive data rates of said primary and secondary streams 
and according to a decoding delay time of said decoder. 

4. A method in accordance with claim 2, wherein: 

the replaced identifying information of said secondary 
stream comprises at least one of program specific 
information (PSI) and packet identifier (PID) informa- 
tion. 

5. A method in accordance with claim 1, wherein said 
pre-splicing packet is a packet of said primary stream with 
an anchor frame start code which is closest to said start time. 

6. A method in accordance with claim 1, wherein said 
primary stream carries compressed digital data, and said 
splicing does not require decompression of said compressed 
digital data. 

7. A method in accordance with claim 1, wherein: 

the discarded data of said pre-splicing packet includes at 
least an anchor frame start code and a data field 
associated therewith. 

8. An apparatus for splicing a secondary packetized data 
stream with a primary packetized data, comprising: 

means for providing a start signal indicating a time to 

initiate said splicing; 
means for determining a pre-splicing packet of said 

primary stream according to said start signal; 
means for providing an output stream where a first packet 

of said secondary stream is positioned to follow said 

pre-splicing packet; 
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means for determining a post-splicing packet of said 

primary stream which follows said pre-splicing packet; 
means for discarding data of said pre-splicing packet 

which is associated with said post-splicing packet; and 
means for adding an amount of stuffing data to said 

pre-splicing packet according to the amount of data 

discarded. 

9. An apparatxis in accordance with claim 8, wherein the 
packets of said primary stream and said secondary stream 
have identifying data associated therewith, further compris- 
ing: 

means for retrieving said identifying data of said primary 
stream; and 

means for replacing said identifying data of said second- 
ary stream with said identifying data of said primary 
stream. 

10. An apparatus in accordance with claim 9, wherein: 
the replaced identifying information of said secondary 

stream comprises at least one of program specific 
information (PSI) and packet identifier (PID) informa- 
tion. 

11. An apparatus in accordance with claim 8, further 
comprising: 

means for providing a number L of null packets in said 
output stream to prevent a buffer overflow at a decoder 
which receives said output stream; and 

means for inserting said null packets between said pre- 
splicing packet and said first packet; 

wherein said number L is determined according to respec- 
tive data rates of said primary and secondary streams 
and according to a decoding delay time of said decoder. 

12. An apparatus in accordance with claim 8, wherein said 
pre-splicing packet is a packet of said primary stream with 
an anchor frame start code which is closest to said start time. 

13. An apparatus in accordance with claim 8, wherein: 
the discarded data of said pre-splicing packet includes at 

least an anchor frame start code and a data field 
associated therewith. 

14. An apparatus in accordance with claim 8, wherein said 
stuffing data is added to said pre-splicing packet in an 
adaptation field thereof, further comprising: 

means for creating said adaptation field if said adaptation 
field is not already present in said pre-splicing packet. 

15. A decoder for decoding a transport data stream which 
comprises a secondary packetized data stream which is 
spliced with a primary packetized data stream, wherein a 
first packet of said secondary stream is positioned to follow 
a pre-splicing packet of said primary stream, said decoder 
comprising: 

a buffer for storing said transport data; and 

a processor coupled to receive data from said buffer for 

processing said transport data; wherein: 
a number L of null packets are provided between said 

pre-splicing packet and said first packet to prevent 

overflow of said buffer; and 
said number L is determined according to respective data 

rates of said primary and secondary streams and 

according to a decoding delay time of said decoder. 

16. A method for splicing a secondary packetized data 
stream with a primary packetized data stream, comprising 
the steps of: 

providing a start signal indicating a time to initiate said 
splicing; 

determining a pre-splicing packet of said primary stream 
according to said start signal; 
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providing an output stream where a first packet of said 
secondary stream is positioned to follow said pre- 
splicing packet; 

determining a post-splicing packet of said primary stream 
which follows said pre-splicing packet; 

positioning said post-splicing packet to follow a last 
packet of said secondary stream in said output stream; 

discarding data of said post-splicing packet which is 
associated with a packet of said primary stream which 
precedes said post-splicing packet; and 

adding an amount of stuffing data to said post-splicing 
packet according to the amount of data discarded. 

17. A method in accordance with claim 16, wherein said 
post-splicing packet is a packet of said primary stream with 
a sequence start code which directly follows a sequence end 
code which is associated with said last packet of said 
secondary stream. 

18. A method in accordance with claim 16, wherein the 
packets of said primary stream and said secondary stream 
have identifying data associated therewith, comprising the 
further steps of: 

retrieving said identifying data of said primary stream; 
and 

replacing said identifying data of said secondary stream 
with said identifying data of said primary stream. 

19. A method in accordance with claim 18, wherein: 
the replaced identifying information of said secondary 

stream comprises at least one of program specific 
information (PSI) and packet identifier (PID) informa- 
tion. 

20. A method in accordance with claim 16, comprising the 
further steps of: 

providing a number L of null packets in said output stream 
to prevent a buffer overflow at a decoder which receives 
said output stream; and 

inserting said null packets between said pre-splicing 
packet and said first packet; 

wherein said number L is determined according to respec- 
tive data rates of said primary and secondary streams, 
and according to a decoding delay time of said decoder. 

21. A method in accordance with claim 16, wherein: 
said pre-splicing packet is a packet of said primary stream 

with an anchor frame start code which is closest to said 
start time. 

22. An apparatus for splicing a secondary packetized data 
stream with a primary packetized data stream, comprising: 

means for providing a start signal indicating a time to 

initiate said splicing; 
means for determining a pre-splicing packet of said 

primary stream according to said start signal; 
means for providing an output stream where a first packet 

of said secondary stream is positioned to follow said 

pre-splicing packet; 
means for determining a post-splicing packet of said 

primary stream which follows said pre-splicing packet; 
means for positioning said post-splicing packet to follow 

a last packet of said secondary stream in said output 

stream; 

means for discarding data of said post-splicing packet that 
is associated with a packet of said primary stream 
which precedes said post-splicing packet; and 

means for adding an amount of stuffing data to said 
post-splidng packet according to the amount of data 
discarded. 
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23. An apparatus in accordance with daim 22, wherein 
said post-splicing packet is a packet of said primary stream 
with a sequence start code which directly follows a sequence 
end code which is associated with said last packet of said 
secondary stream. 

24. An apparatus in accordance with claim 22, wherein 
the packets of said primary stream and said secondary 
stream have identifying data associated therewith, further 
comprising: 

means for retrieving said identifying data of said primary 
stream; and 

means for replacing said identifying data of said second- 
ary stream with said identifying data of said primary 
stream, 

25. An apparatus in accordance with claim 24, wherein: 
the replaced identifying information of said secondary 

stream comprises at least one of program specific 
information (PSI) and packet identifier (PID) informa- 
tion. 

26. An apparatus in accordance with claim 22, further 
comprising: 
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means for providing a number L of null packets in said 
output stream to prevent a buffer overflow at a decoder 
which receives said output stream; and 

means for inserting said null packets between said pre- 
splicing packet and said first packet; 

wherein said number Lis determined according to respec- 
tive data rates of said primary and secondary streams, 
and according to a decoding delay time of said decoder. 

27. An apparatus in accordance with claim 22, wherein: 
said pre-splicing packet is a packet of said primary stream 

with an anchor frame start code which is closest to said 
start time. 

28. An apparatus in accordance with claim 8, wherein said 
primary stream carries compressed digital data, and said 
splicing does not require decompression of said compressed 
digital data. 

29. A method in accordance with claim 1, wherein said 
stuffing data is added to said pre-splicing packet in an 
adaptation field thereof, comprising the further step of: 

creating said adaptation field if said adaptation field is not 
already present in said pre-splicing packet. 
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